Sampling with prior knowledge for high-dimensional gravitational wave data analysis
نویسندگان
چکیده
Extracting knowledge from high-dimensional data has been notoriously difficult, primarily due to the so-called "curse of dimensionality" and complex joint distributions these dimensions. This is a particularly profound issue for gravitational wave analysis where one requires conduct Bayesian inference estimate posterior distributions. In this study, we incorporate prior physical by sampling desired interim develop training dataset. Accordingly, more relevant regions feature space are covered additional points, such that model can learn subtle but important details. We adapt normalizing flow method be expressive trainable, information effectively extracted represented transformation between target Once trained, our only takes approximately 1 s on V100 GPU generate thousands samples probabilistic purposes. The evaluation approach confirms efficacy efficiency inferences points promising direction similar research. source code, specifications, detailed procedures publicly accessible GitHub.
منابع مشابه
Methods for regression analysis in high-dimensional data
By evolving science, knowledge and technology, new and precise methods for measuring, collecting and recording information have been innovated, which have resulted in the appearance and development of high-dimensional data. The high-dimensional data set, i.e., a data set in which the number of explanatory variables is much larger than the number of observations, cannot be easily analyzed by ...
متن کاملOn landmark selection and sampling in high-dimensional data analysis
In recent years, the spectral analysis of appropriately defined kernel matrices has emerged as a principled way to extract the low-dimensional structure often prevalent in high-dimensional data. Here, we provide an introduction to spectral methods for linear and nonlinear dimension reduction, emphasizing ways to overcome the computational limitations currently faced by practitioners with massiv...
متن کاملSHrinkage Covariance Estimation Incorporating Prior Biological Knowledge with Applications to High-Dimensional Data
In “-omic data” analysis, information on the structure of covariates are broadly available either from public databases describing gene regulation processes and functional groups such as the Kyoto encyclopedia of genes and genomes (KEGG), or from statistical analyses – for example in form of partial correlation estimators. The analysis of transcriptomic data might benefit from the incorporation...
متن کاملDetermination of Optimal Sampling Design for Spatial Data Analysis
Extended Abstract. Inferences for spatial data are affected substantially by the spatial configuration of the network of sites where measurements are taken. Consider the following standard data-model framework for spatial data. Suppose a continuous, spatially-varying quantity, Z, is to be observed at a predetermined number, n, of points ....[ To Countinue Click here]
متن کاملAn Information Matrix Prior for Bayesian Analysis in Generalized Linear Models with High Dimensional Data.
An important challenge in analyzing high dimensional data in regression settings is that of facing a situation in which the number of covariates p in the model greatly exceeds the sample size n (sometimes termed the "p > n" problem). In this article, we develop a novel specification for a general class of prior distributions, called Information Matrix (IM) priors, for high-dimensional generaliz...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Big data mining and analytics
سال: 2022
ISSN: ['2096-0654']
DOI: https://doi.org/10.26599/bdma.2021.9020018